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ABSTRACT 

The purpose of this study was to investigate the 
impact of the isplemantation experience on an educational innovation. 
The topic suggests that users impact innovations just as innovations 
impact the user. The study's paradigm for implementation has three 
components--frogram specifications, the procedures specified fot the 
innovation; tser*‘practices, the ways the user performs the task prior 
to the introduction of the innovation; and operational 
characteristics, the actual manner in which the user operates the 
innovation. In this paradigm, implementation is conceived as a 
bilateral event: both the innovation and user “are altered. Two types 
cf mutual adaptations were identified in the elementary reading and 
mathematics programs examined--those that were mixtures of and those’ 
that were actually different from the related program specifications 
and user practices. Conditions affecting alterations to the programs 
were the non-dynamic features of the user's environment, the other 
Frograms that the user operates, emergent innovations, the 
incospleteness of the innovation, ramifications of other 
alternatives, and the evaluative judgments of the user. This study 
has clearly shown that the innovation was impacted during 
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BACKGROUND OF THE STUDY ( 
° . The purpose of the study.is to investigate the impatt of the implementation 
experience on an educational innovation. The topic suggdsts that users impact 
~ innovations just as innovations impact ‘the user. the interactive effects of 
these impacts is an important element of implementation. It is the gap between 


theory and practice as well as_ the unification of theory and practice. 
In this study implementation is thought of as a process during which 7 


the innovative system and the user system are altered. ‘The innovative ‘ 
‘ ; . 
system is a specified way of performing a task such as ‘the teaching of 


reading. The task may be a different way of performing a function which 


O° a 


is part of the user system or it may be a task which is completely new to 


the user's system. Although the innovation may be similar to the user 


system, it is innovative only because it differs, in some respects, from 
it. 
In this study the innovative system is seen as a fairly clear set 


of procedures for the user to follow. These procedures shall be referred 


. 


to as the program specifications or PS. 


The user system shall be nag eta! user’ practices or UP. The user 
practices are the ways the user performs the task prior to the introduction 
\§ the innovatton. 


The actual manner in which the user operates the innovation shall be 
dalled the operational characteristics or OC. It should be noted that the 
operational characteristics of an innovation may be quite different than the 
program specification. This is consistent with the notion that implementation 


‘is a process infwhich both the innovation and user systems are altered. 


Figure 1 serves as a basic paradigm for implementation. it shows the 
user practices (UP) and program specifications (PS) interact and result in 
the Operational characteristics of the {nnovation. _ This paradigin will be 


elaborated on as the study develops. 
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Figure l 
Paradigm for Implementation 


This paradigm for implementation conceptualizes change as a bilateral 
‘ ¢ 
event: voth the innovation and the user are altered. lhis particular view 
of change may be identified in the philosophic writings af. Bebe (1976), 
Fuller (1972), and Suzuki (1973). In ee ee writings, it has been 
called "reciprocal impact" bye Knell and Mueller (1966) and has been discussed 
by Jourard (1968) and Laing (1969). \ similar vantage point has been adopted 
by Churchman and Schainblatt (Feb. and Oct. 1965), to study the gap between 
the manager and management jetoneinés, . 

Yithin implementation studies the concept of bilateral change has been 


expressed by Beers (1975), davelock and Havelock (1973), and Miles (19678. 


Hall's Concerns-sased Adoption Model (1974), while focusing on user activities, 


clearly indicates the essence of bilateral change. Studies of mutual adaptation 


have shown how the user and innovation are altered during implementation (Mann, 
1975; McLaughlin, 1975 and Wirt, 1975). The paradigm for implementation also 
shows that the operational characteristics are outside of the user and foencnne 
tion. ' This is intended to show that they are unique and unpredicted by the " 
user and innovation. Fuller (1972) has referred to this event as synergism. 
The synergy of implementation has bean recognized in the writings of Havelock 


and Havelock (1973) and Colvard oe Hall's Concerns-dased Adoption Model 


clearly illustrates the application of synergy to implementation. 
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PRESENTATION AND-ANALYSIS OF DATA 

Introduction 

(fhe major elements of the study are the innovation's program specification, 
the apes poaceiees prior to implementation and the operational characteristics 


of the innovation. the innovation and user were related through the Follow 


Through sponsorship program as previously described. The innovation of concern 


to this study is the Learning Research and Development Center's (LRDC) Follow 
Through Instructional Model. ihe user is a large rural school disertc’ ic 
central Pennsylvania. Seven elementary schools in the district use the 
innovation in kindergarten through grade three. Schaols at extreme ends of 
the’ district, are fifty miles apart. LRDC and the school district worked 
together for seven years at the time of this study. 

Control of implementation has been maintained by supervisors employed 
by the school district and consultants employed by LRDC. Teacher contact 
concerning the innovation has been’in the form of pre-service training, 
in-service trdining and classroom supervision. 

this particular user was selected for.the study because of the extensive 


alterations {t h&d made to the innovation. It does not necessarily represent 


all users of the LRDC programs. 

The qpestion being asked is, "What is the impact of the implementation 
experience on an educational innovation?" The second chapter of this study 
discussed the question theoretically. That discussion pointed to the view 
of the bilateral change and synergism as events of implementation. The paradigm 
presented in Figure 1 and extended in Figure 2 represent the merger of the 
program specifications and the user practices to form the operational character- 


istics. The research design uses this paradigm as its basis and expends upon 


it by identifying the program specifications, the user practices that” are 


e 


related to egch program specification, i the operational characteristics 
of “the ingg ation. Analysis of-the data involves the following proced res. 
Firs , the theoretical notionggof bilateral change dnd synergism are 
) ‘ 
appljed/to the data. ([f bilateral change and synergism are applicable notions, 
then ghe operational charactefistics ought to be different than the user 
— ices and the program specification. The concept of mutual adaptation 
as/presented by Mann (1975), McLaughlin (1975), and Wirt (1975); a discussed 
n the second chapter of.this study, is used to see if both the user and the 
innovation have been altered. 
Secondly, the operational characteristics are compared and contrasted 


with the program specification to determine how and why implementation has 


impacted the innovation. i 
2. Presentation of the Data 


ihe data usedsin this study are statements describing the innovation's 


-_ . 


program specitications,, the operational characteristics of the innovation, 
and the user practices prior to implementation. 


The innovations in this study are four instructional programs: (a) Sullivan 


JReading Program (adapted by LRDC), (Bb) Selected, Directed and Skills Reading, 
a 
(c) the Primary Education Projecce (PEP), and (d) IPI Math. [hese four programs, 


1 


vorking together, form the basis for the LRDC Follow Through Instructional Model. 


n tirst grade students begin the Sullivan Reading Program and, upon completion, 


L 
' 


enter’ the Selected, Directed and Skills Program. The PEP curricula is generally 


ee Chought, of as a kindergarten program although its use sometimes extends to the 


Tirst grade. It consists of the Classification and Quantification programs, and 
a Perceptual Development Program that contains auditory motor, Visual motor, . 


general motor and letters and numerals curricula. when students complete 


’ 


Quantification, they begin the IPI Math program. 


% 


The development of these evhe puveran may-be thought of as occurring in 
four distinct stages. The first stage involved the creation of a shitieeantts 
Pisani eins for the programs. They are stated, here as aims for program developers: 
a. To provide for reliably assessable indiVidual differences sone learners, 
b. te Jeueiae mastery of subject matter.as the child a through the | 
curriculum, . | 
c. to develop self directed and self-initiated learners through instructional 
procedures which provide for self-sglection- and self-evaluation, and 
d. To provide opportunities for the child to become actively involved in 


| 
the learning process. (Bolvin and Glaser, 1968, p. 829) ) 


The second stage of development concerned the way the programs were to be 


designed so that the aims would be achieved. ‘he following is a retrospective 


y 
v* 


description of those design goals: 

a. Structured Curriculum - cach content area is comprised of a series 
of behavioral objectives arranged in a hierarchical order. These series of 
objectives serve as the content, scope, and sequence guide for learning. 

b. individualized Instructional Materials - Individualized materials 
are identified from commercial sources, or developed at LRDC and on-site to 
natch the cuMiculum objectives. 

c. «Assessment System - Criterion referenced tests are part of an 
individual diagnostic and prescriptive procedure for placement of individual 
students in the curricula, guiding educational experiences, and for feeding 


back information to the student and teacher. 


d. Management System - A management system designed for the individual- 


a) 
N 
& 
tal 

o 
[o) 
>) 
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rocess enables teachers to identify and provide individual educational 
programs and learning experiences through the understanding of the teacher 


role, the development of self-management skills in students, and the organiza- 


tion of the classroom. (Eichelberger & Boston, 1976, pp. 3-4) 


In the third stage, the designers developed programs that reflected these 


_ 


goals and aims. During the fourth stage these products were field tested for 


ugability.: If necessary, the programs were altered using the:principles and 


aims as a blueprint. 


These programs, along with their teacher guides, contain what this study 


is calling program specifications. ‘he writer has extracted the specification 


from various documents. fhey were verified by the LRDC Field Services staff ) 
and the site superviséry staff. 
A primary consideration in the development of the list was the level of 


Z ‘ 
specificity that would be used. If the program specifications were too general, 


they may not serve to discriminate between the design of the program and the way 


site was operating it. If they were too specific, one would find each teacher 
operating the program differently. The’ final list seems to be of an appropriate 
specificity. It discriminated between the design of the program and site's opera- 
cion of it. 

second major consideration concerned the brevity with which the list 


could be constructed and still be ugeful in data collection. With this con- 
. 

sideration in mind, such items as complete listings of instructional objectives “~~ 

aaa 

ind materials were excluded. Also, abbreviated notations were used when posgible. 


a | 
. 
(Although the process of data collection will be attended to later, it shoul 


* 


now be noted that the writer collected that data and discussed each specificat 
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in detail to ensure that the respondent and he agreed upon ‘its meaning.) Because 


of 


the brevity of the list, the reader who lacks operational familiarity with 


the programs is likely to find it difficult to comprehend. The list of program 


a 


specifications is found in the Appendix. 


1 
Gathering data concerning the operational characteristics of the programs 


.= 


at site relied on the following procedures. First, the writer met individually 


with each of the three Educational Specialists (i.e., supervisors) at the site's 


Follow Through Program. Each Specialist assumes responAbility for either PEP, 


math or reading. ° In the meetings’ the writer presented each specification and 


asked the Specialist to describe how it was operationalized there. The responses 


, f 4 
\ were recorded. [his procedure was used to prepare a first. draft of the operational 
characteristics for each program. lhe list was returned to the Educational 


Specialists for their approval. 
i 


During. ensuing visits to the site, the writer observed each characteristic 
: : ~ Cc = 62 t ' t 
operating in at least three classrooms for further verification. when discrepancies 


_existed between the observations and Educational Specialists report, which happened 


‘ 
only occasionally, the writer interviewed the teacher and/or redefined the charac- .~ 


teristics. some operational characteri$tics were unobservable. In these cases, 


-he writer discussed the characteristics with the teachers to either verify or 
edefine it based on the teachers comments. thus, a second draft of the operation- 


il characterists was prepared. 


Finally, the second draft was presented to the Educational Specialists 
Sr their information-and final approval. Their comments tended to be further 


elaborations upon the data ahd were incorporated in the third and final version 
. 


tagcre characteristics which is found in the Appendix. 


Curricula structure, instructional materials, and assessment: and management 
. 


systems are as much a part of a,conventional scnool as they are of the innovation. 
bad 
'‘*. 
chat is, a structural correspondence exists between the systems. chis is re- 


ferred to here as an analogical relationship. [The user practices are the pre- 
implementation activities of the user, that are analogically.related to the 
program specifications. iow the users organized their activities, and what 

, 


their purpose was, is not of central interest to thig study. What is of 


interest is, what the user did in relation to each altered program specification. 
’ 


g 


BY 


: ‘ 
These were not documented prior to implementation and the writer's attempts 


‘to gather them from documents and interviews were unsuccessful. Thus, the 


writer generated them from his, experiences in public schools. The program 


5 


specifications and operational characteristics served as a context for the 


generation activity. The user practice had to (a) be in analogical relationship 
‘ : 


tothe prdgram specification and user practice and (>) have the potential of 
= s 


contributing to the direction of the alteration. 


J ) 


in some cases it was not possible to generate a user practice and in some 


¢ 


cases the one generated seems to be contrived. Occasionally, a user practice is 

‘ ‘ ; % 
a statement denying that a practice extisted rather than establishing dne. 
However, to the extent possible, the user practices describe how tHe user operated 


. 


prior to implementation. 


ri,’ * . 


Sincé the user practices were generated in the context of program 
e « - 
spécification and- operational characteristics, they are also displayed in 
that context, (see Table 1). Table 1 displays a condensed version of the 
. c 
data concerning the program specifications, operational characteristi¢s 
and user practices. Rudimentary analytic information is also contained on ) 
thac table. ; - ‘ 
the major headings on the table refer to the specific instructional 
" programs which compose the innovation. 4s sub-headings under each, ‘instruc- 
; , { \ ’ ; 
tional program are the operational characteristics of that program. The . . 
first two columns under each operational characteristic contain the related 
program specification and user practice. 
In the third column is a description of how the operational characteristic 
may be viewed as a mutual adaptation. shis is an important. step in defermining 
the applicability of bilateral change and synergy to implementation. Also, 


in that third column is a brief rationale for the alteration. ihese were 


provided by the user during data\collectton. 


10 


The fourth column states the ramifications of the alteration being 


discussed. That is, a change made to a program specification may cause 


changes in other related program specifications. 


Table 1 


. 


Opérational Characteristics and Related Program Specifications, 


User "t 


Aw? Sul }ivay Reading Program (adapted by LRDC) 


ctices, Mutual Adaptations and Ramificagions 


i a eel Ne cee pace eens 


~-—- +--+ re 


~ 


a + + Hp a Oe ee - - - 


(OC) .The pre-reading and reading readiness section of the Sullivan Reading Program teaches 
the sounds*required by the Sullivan Program and all consonant sounds. 


Specification 
The pre-reading and 
reading readiness , 
program teaches the 
sounds required by 
Sullivan 


_ Teacher made materials 
aré used for pre-reading 
_and reading readiness. 


~ Practice 


Pre-reading and reading 
readiness were taught in 
kindergarten and prepared 
students for first grade 
readers. 


‘ 
Site did not use Sullivan 
pre-reading and reading 
readiness materials. 


Mutual aoa ; 
Adaptation Ramification 
Site uses the techniques 

of pre-reading and reading 
readiness. The innovation 
now includes thé teaching 

of all consonant sounds, 
(Site does not necessarily 
track students from Follow 
Through kindergartens to 
Follow Through first grades. 
Thus, it is necessary to 
prepare students for non- 
Follow Through reading pro- 
prams by teaching all con- 
Sonant, sounds.) __ e 


The alteration to 
,the objectives also 
altered the materials. 


Both site an@ the innovation This alteration 

now use Sullivan pre-reading effected the objec- 
and reading readiness tives of the pre- 
materials, (Thid introduces ‘reading and Treading . 
students to the skills and readiness programs. 
format of Sullivan Book 1.) 
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id 


fable 1 Continued 


. 


4. (OC) The Group Directed and Directed Reading programs use the materials and objectives of a 


basal reading text. - 
nN The Group Directed The reading program uged Site now, uses the Basal text tests are } 
and Directed Reading in the primary grades Selected and\Skills « used to assess progress 
programs use the prepared students for - reading: progpons. The . in the reading program. 
materials and ob- the intermediate reading innovation h&s acquired The time required for 
jectives specified _ program. ; a basal text, which in- Group Directed and 
in their lesson plans.’ . cludes its own skills Directed Reading has . 
‘ program, in place of increased. ia 
Directed Reading. (The are NG? 
. Group Directed Reading ¢ 


programs were not pre- 

paring students for 

the intermediate grades. 

The use of basal texts 
xX makes the transition 

smoother.) i 

. . . 

4, (OC) Unit and End-of-Book Tests are used in Sullivan’ but mastery- is determined by teacher judgement. 


specified criteria teacher judgement was Site now uses the concept 
determines mastery of predominant means of of mastery and applies 
.@ Unit and End-of-Book assessing progress. assessment to individual 
fests in Sullivan. students. The innovation 
% uses teacher judgement 


rather than a specified 
4 criteria to determine 
mastery. (The End-of-Book 
Tests are inadequate in ' 
. ; : the selection of and 
* number of items. 


5. (OC) A prescription sheet directs teacher-student interactions in Sullivan Books 1 and 2. 


Students are paced Not applicable. Both site and the ffindvation 
through Books 1 and 2 now use a prescription sheet 
for Books 1 and 2. 


a ae | | 1d 


y ; 
Table 1 Continued 


~ , 


—_————$$ $$$ SSeS 


a — — —w- ———__——— — 


a6 pb. (UC) Sullivan Worksbooks and Tapebooks are available in the "Modification Compact Version" for 


Boaks 15-17. This version has the workbook and tapebook pages in the sai aie mt 
on the prescription stteet and they are- laminated for re-use. 


SS ee ————— I ——— 
e - 
sullivan Workbooks Not applicable. Both Site and the ¢ 
and Tapebooks are innovation now use a 
kept together in a , "Modified Compact 
binder and used as * . Version" of Books : 
ig . specified on the eS 15-17. bi 
_ —tC—i—“‘éiP I eScription sheet. ee eee one a 


B. Selectedsirected and Skills Reading 


Ll. . (UC) The books used for Selected Reading are those that dre included in the Scholastic Reading Kit. 


—~ ---—--- - - + Cr 


‘ the Selected Reading The library loan |. Implementation systematized The alteration of the 
books are used as program at site was site's practices in the materials also effected 
specified in the a form of Selected area of Selected Reading and the objectives of the 
Selected Reading Reading. »*’ altered the materials of the program. 
lesson plans. innovation. (The size and - 


number of schools in site 
- made it difficult and ex- 
pensive to supply selected 
materials. Scholastic Kit 
emerged as a similar but ‘ ¢ 
self-contained program. : 


‘ 


2.° (OC) 


Table 1 Continued 


—_—— 
' 


The materials used for the Skills Reading program are sometimes supplemented or replaced by the 
Educational Progress eorper ration materials. 


The Skills Reading 
materials are 
as specified by the 
Skills Reading 

ho” program. 


used 


, 


3s (OC) 
t language arts. 


$a 


the Library and 
Reference Skill 
units are to be 
used as specified 
in the Skills 

A Reading Program. 


ee SPT ee AE A, | | LR ee es Lee 


Teacher or aide gets instructional materials for students in IPI Math and Skills Reading. 


Students get their 
own materials for 
[PI Math and Skills 
Reading. 


13, 


Reading skills were 
taught.as part of 
the basal reading 
program. 


skills instruction in reading 
became individualized and 
taught outside the basal read- 
ing .group: The materials of 
Skills Reading were altered. 
(The size of site and the num- 
ber of schools involved made 
it difficult and expensive for 
them to supply the materials \ 
required by the Skills Reading 
program. EPC emerged as a self- 


Lak ee , contained replacement.) e 


The use of Educational 
Progress Corporation 
materials altered the 
‘objectives for Skills 
Reading in some.class- 
rooms. 


i 
2) 


The Library and Reference Skill units-of ‘the Skills Reena Program are taught fn library and 


é 


—— 
bite taught library ' Sites librarians and language 
,and reference skills arts teachers have the Library 
in the library’ and .and Reference Skill units 
language arts programs. available to them. The innovation 
no longer contains those unfjts, 
(The size of site and the number 
of schople involved made.it difficult NX 
and expensive for them to supply all 
the reference materials referred to 


w in the Library and Reference Skills 


ig . 
(Not a mutual adaptation.) User Practice. 
(The storage shelves and storage centers 
required for pupils to get their own 
materials would be too expensive due 

,to the number of schools involved.) 


textbooks and othep® 
instructional materials 
were either kept by the 
sstudent or distributed 
by the teacher. - 


Table 1 Continued 


pa a a ee 


C. .PEP 


—_————$ $s —— ——$ 


1. (OC) Classification unit 7 and Quantification units 8, 13, and 14 have been eliminated. 


—————_—____1— 


Classification and Site kindergartens (Not a mutual adaptation.) User practice. 

Quantification ob- did not teach these (The objectives are not generally taught 

jectives are to be objectives. at this grade level and are extremely 
_ used as specified. .- es difficult to teach.) 


2. (OC) Classification units 4 and 5 are not necessarily taught in the specified sequence. Group instruction 
is used for these skills. F 


gadis i units Not applicable. Site teaches Classification 4 and 5.. 

4 and 5 arg taught The sequence of units for Classifica- 
following mastery of tion as specified by the innovation 
unit 3. individual- . is not foloowed, now are materials 
ized materials are a . individualized. (This alteration is 
predominant means of necessary for the innovation to 

- instruction. articulate with the seience program.) 

Si (OC) The General Motor program is. taught by some physdc&l education teachers. 4 
General Motor is a Many skills of the Some site physical education teachers 
part of the PEP ’ General Motor program now teach the General Motor program 
curriculum. - were considered to be and, ih those instances, it is not part 

part of a physical of the PEP curricula. 
J education program. ‘ j 
. * Fp 7s . 
eo - 
é . 
4 > 
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Table 1 Continued : 


4. (OC) Teacher judgement is used to assess student behavior when they begin to work in a PEP skill. Post 
t. sting is done when students complete work on+a skill. Post test material is the same format as 
lesson material and teacher judgement determines mastery level. 


Pre and Post tests feaecher judgement Site has altered its practices The branching . 
are used to determine determined a group's by focusing on individual rather hierarchy is not 
the student's needs needs in a unit. than group needs. The innovation manageable in this 
within a unit. Special Testing was-done in has been altered to diagnose situation. It is now 
testing materials and + a group setting and needs within a skill rather a linear hierarchy. 
setting are used. group standards than within a unit. Level of Also, the testing 
determined mastery. mastery is determined by the | role and testing | 
teacher rather than a specified space have been ,. 
score. An instructional format altered. : ‘ 
: is used for testing rather than a 
the specialized PEP testing for- 
i : mat. (Removal of specialized test- 


ing procedures allows both adults 
to be avaflable for instruction 
in the PEP timeblock. 


. 5. (OC) 


Learning centers and AIMS materials are often used rather than boxes, in PEP. 


jokes are predominant Not applicable. Learn- Site and the innovagion now uses Ir some Basses, AIMS 
materials for instruc- ing centers and AIMS AIMS materials indcacning centers objectives that are 
tion in PEP. emerged as innovations (The AIMS materia4s and learning not a part of the PEP 
: that were applicable ~ center idea were emergent innova- curricula are added 
to PEP. tions that’ were applicable to site to the program. 


“ . 


and the innovation.) 


' 
o. (OC) At least forty-five minutes a day, three days a week are spent in the PEP curricula. 


At least sixty minutes Not applicable. Instruc- Instructional time is organized as : | 


a day, five days a tional time was not or- specified by PEP, but the time 
week are spent in the ganized around PEP period is shorter. [Site has one- 
PEP curricula. blogks. half day kindergarten sessions into 
: - which PEP, conventional kindergarten 4 
’ % a curricula and special classes 


(physical education, library, etc.) 
must be scheduled, ] 


2. ' Table 1 Continued 
~~ . : Pa 
D. IPL Math 
a ee ees ei ee ; 
1. (OC) When students leave the Quantification program they work in either Contenintal Press or A-level 
1P1 Math materials before beginning ‘B-level IPI Math. , 
When.students leave Not applicable. Both site and the innovation now 
Quantification tftey c use the Contenintal Press or 
begin work in B-level . _ A-level IPI Math materials. 
IPI Math. (They provide a-necessary transi- 
Py : tion from Quantification to IPI 


ea a ee en eee Math.) 
; ry 
2. (OC) A Metric Education program. is used ih place of Systems of Measurement in TPI Math. 


¢ 


the objectives and ‘Not applicable. Site follows their'own group : 
materiafs of the IPI 2 instruction procedures for 

Math program are . : teaching Metric Education as 

used as specified. . -part of IPI Math. The: innovation 


“ ie includes a metric unit rather 
. ; than systems of ‘measurement. 


3. (OC) Group instruction has replaced individualized instruction in the IPI Math skills for money, time, 
geometry, and systems of measurement. 


Individualized book- Group instruction Implementation resulted in site using 
lets are predominant was’ the predominant individualized materials to teach 
means of iastrvetion means of teaching basic math skills (addition, multi- 
in IPI Math. math in site. plication, etc.) andthe innovation 


was altered by the use of group in- 
r struction for the teaching of other 
ek : math skills (money, .time, etc.). (The 
roe size of site and the number.of schools 
involved. made it difficult for them to 
‘ ; maintain an inventory and control the 
3 or ae 2 cost of the IPI Math program. It should 
a“ . . also be noted the site was criticized by 
7 ‘ a ‘ parents for its lack of group instruction 
24. : in math.) 


ve 


nr 
Cr 


\ 
J Table 1 Continued 


(OC) Teaching booklets for eight IPI Math oe eliminated because they were ineffective. ) 


Feaching booklets Site did not use (Noe a mutual adaptation.) ’ Elimination of in- 
are used to teach materials that they User Practice. effective materials is 
each objective in considered to be .  eonsidered to be a 
the IPI Math program. inneffective. ~ program completion 

" = algeration. 


eae In IPI Math teacher judgment is used to determine studegt' s needs within a skill. Skill tests 


determine further needs after completion of the skill. — 
Pre-tests are used to Teacher judgment Site now applies the concept of 
determine needs within determined group mastery to most skills. A measure 
,a unit and skill. Skill needs within a of mastery is taken when individu- 
tests are used to deter- skill and unit. als enter and complete a new skill. 
mine maStery upon com- Teacher judgment The innovation no longer relies on 
pletion of a skill; and tests determine unit pre and post tests amd criter- 
post-tests are used to needs upon completion ion scores for mastery. (The size 
determine mastery upon of a skill or unit. of gite and the number of schools - 
completion of a unit. The concept af mastery involved made it difficult to main- 
was not necessarily tain an inventory and ee of 
applied to a : 1s the testing materials 


(oc) Students are engaged in IPI. Math at least fifty minutes, -every day. 


Students are engaged Minimum number of (Not a mutual adaptation.) User 
in IPI Math at least minutes for math practice. 
- tifty minutes, every was determined 
day. by state require- 
me 


Table 1 Continued 


7. (OC) In almost all cases, students are assigned all pages in IPI Math instructional booklets. 


Pages assigned in Math lesson plans and (Not a mutual adaptation). User 
IPI Math instruc- assignments were in Practice. Assignment ig the 
tional booklets reference to group same for all. 

are individually needs rather than 

selected for individuals. 

Students and 

based on diagnostic 

test results. 


(OC) When beginning work in IPI Math, groups of students are assigned the same unit and paced through 
the instructional materials. . J 


pil 


When-students—begin Teacher judgment-was (Not-a mutual adaptation.) User 
IPI Math, they are used to determine the Practice. (Placement test failed 
assigned a placement beginning math unit to discriminate between students 
test which determines for a group of students. so that most of them started in 

° g the same unit. 


soled of the Data 


Initial examination df the operational characteristics reveal that 
“bilateral change was a prevailing phenomena. In some instances only the 


user was altered and the program specifications were used as designed; in 


other instances only the program was altered and the user operated according 


. 


to previous practices; finally, and in the majority of cases, both the user 
’ - . id 
and the program were altered. This final case represents the bilateral 


change event and may be observed on Table 1 in the mutual adaptation data. 
) 
Examination of these mutual adaptations reveal that two distinct groups 
exist.——One-group-may-be-described-as—a-mixture-of pieces of the related program ~ 


specification and the user practice. For instance, one such mutual adaptation 


indicatedithat students do not progress until they master the given objective, 


ge 
but’ that teacher judgment is used to determine mastery rather than the mastery 


criteria. sere, the innovation is being operated as specified but teacher 
judgment replaced the mastery criteria. This entire group of mutual adaptations 
may be.the result of the size of the unit being examined. Smaller units would 
indicate that (a) students do not progress until they master a given objective 
as specified by the innovation, and (b) teacher judgment is used to determine 
Mastery as indicated by the user practice. . 7 

The other group of mutual adaptations are those that are actually different 
than both the related program specification and uper practice. The use of the 
Scholastic Reading Kit to teach Selected Reading represents this type of 
alteration. Both groups of operational characteristics comply with the 
previously discussed definitions of mutual adaptation offered by Wirt and 
McLaughlin. However,,the latter group seems to be more compliance with the 


definition of synergy offered by Fuller. 


. 


. 
The mutual adaptations indicate that in some cases pieces of the , 


innovation were deleted; in other cases pieces were added to the innovation; | 


i : : 
and in still other cases substitutions were x The elimination of certain 


units from the PEP program represents program wtetiong: The inclusion of 
Continental Press and A-level IPI Math materials represent additions to the 
innovation. The use of basal texts, rather than the specified materials, to 
teach Directed Reading, illustrates a substitution. The fact that these types 
of alterations could be made to the programs without disrupting the entire 
systems indicates an advantage of segmentable programs. Pieces can be dropped, 


‘ - 


added and substituted; and the-programs—remain-stable: 

Whether the study has demonstrated the synergistic nature of implementation 
is not clear. Certainly, the system of operational characteristics is unique 
and unpredicted by the component systems, However, it is necessary to question 
whether this, reflects synergy or the naivety with which the component systems 


were initiddly considered. For instance, Figure 3 shows a reconsideration of 


these component systems. The operational characteristics may still be un- 


predictable from ‘this more’ complete set of components. However, ‘this set of 


components may be used to explain thy emergence of the operational characteristics. 


Figure 3 ; * 
Paradigm for Implementation Reconsidered 


User Practice Emergent Innovations ° Program 


i ae UR ee is Specifications 
Zz ‘ 


Operational 


Ocher ee Characteristics ———. Rasa Sceer One, SF 


Systems . other Alterations 


3 
Non-Jdynamic Features 
of the User's ‘ae—~, 
These components will be explained and discussed further in this analysis 
Presently, it is important to note that further study is necessary to determine 


whether ghis paradigm adequately explains the operational characteristics at 


other sites using the LRDC model and at sites using other models of instructtion. 


7 


eal 


Interestingly, it is not the dicotomous relationship between the innovatidn 
and the user that is seen as causing tiese alterations. The alterations are 
the results of decision making situations. The decision making situations 
are seen as being caused by certain conditions of the innovation and the users: 
These conditions which provide the opportunity for decision making are identified 
and discussed in the following narrative. 

There are certain features of the user's environment which are non-dynamic 
and do not adjust to the needs of the innovation. References in the data-to time 
and the size of site illustrate this condition. The Selected, Directed and Skills 
Reading programs require many reference materials. Districts operating this 
program-in-one/or two—buildings-have-no-difficulty-providing-them-in-learning~ — 


material or Each center can wucvivn as many as eight classrooms. However, 
site would need seven such centers; some of with vould service only twa 
classroams. .ihus, the programs cost two and one-third times more to operate 
rural site than’ in a more urban setting. ° - 


‘ i 
The innovation is effected by other programs that the user operates. 


As the innovation becomes part of the user's system it interacts with other 


programs and is changed. (Likewise, the other prograhs ‘in changed.) For 

: ’ 
instance, the user's third grade reading program neéds to articulate with 
the fourth grade biudiny program. The use of the fourth grade basal reading 
_ Series by the, Group Directed and Directed Reading prograns makes the transition. 
from one program to the other easier for students. 

The adoption of the General Motor curriculum by some physical education 
iaialiain serves to further illustrate this point. In this instance, ‘ program 
ee at the same grade level-> effects, and is effected#y, the innovation. 

Emergent innovations also effect the letiovadhan,: This is particularly 
true of the PEP/IPI Mode} which has served as an exemplar for a type of 


individualized instruction. The use of AIMS materials and the Educational 


Progress Corporation materials serve to illustrate this condition. 


. 
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Many of the alterations occurred as the user completed the innovation. 
User completion alterations may be exemplified by the development of a pre- 
scription sheet for Sullivan Books 1 and 2. This prescription sheet organized 
teacher-student activities that were necessary for pacing students through these 
books and made it easier for the teacher to conduct the program.‘ Thus, it is 
considered to be a completion activity. 

+ Finally, many of the alterations were the ramifications of wehae alterations. 
In programs that are as systematically designed as these innovations, alterations 
made to one specification will impact related specifications. This is particularly 
observable.in the alterations nadetto instructional materials; they almost—always 


effect the curriculum structure and, frequently, the assessment system. 


Although evaluative judgments concerning the effectiveness of the programs 
was not within the scope of the study, it certainly must be considered as a 
condition which could provide for an alteration. “The elimination of eight 
IPI Math booklets was related, by the user, to the ineffectiveness of the 
Seeuckala The sinearas items tested on the Sullivan reading aaa and the 
cane Tey of IPI Math placement test to discriminate between séaients, were 


cited as reasons for altering or eliminating theiw use. It should be noted 


that some alterations to the IPI Math tests were in agreement with Holland's 


recommendations concerning testing tn IPI (1975, pp. 26-28). Coincidently, 
Holland's research was also \nable to find an advantage to the use of branching 
hierarchies (1965). This would support site's decision to make PEP into a 
linear, rather than branching hierarchy. Thus, in some instances site reported 
ineffectiveness of materials as being the reason for alterations and in two 
cases their alterations were in agreement with Holland's concerns of program 


effectiveness. 


Within the study, the innovation and the user have been thought of as being 


in analogical relationship. hat is, gens program specification has a carrespond- 
ing user practice. The construction of the analogical systems was, in itself, 
an informative process. The following discussion concerns some insites into 
implementation provided by the construction. d | 

As previously discussed, the dicotomous relationship between the re 
and the user do not cause the alteration. They may, however, be in conflic with 
one another. Some conflicts are weny obvioys. .For example, the innovation) specifies 
that students in Quantification should learn numbers and sieves beyond one 


hundred. This is in direct conflict with the user's belief. They believe. that 


students will benefit more from extended work with lesser numerals. Informally, 
_ | 


$ 
the user will most always prevail in these direct cohflict situations. 


| 
| 
Some conflicts are not as obvious. They involve differences in priority 


rather than dicotomous sides of the same issue. For instance, IPI Math specifies 
procedures for placement testing students. All teachers perform this same function. 
They may not be conscious of it, or they may carefully match the ability of children 
and the possible beginning units for instruction. Opposition or acceptance | 


of placement testing is more likely to be based on the outcomes and context élements 


of the activity rather than on the activity itself. Thus, the conflfct, and 
the decision making to resolve the conflict will not occur until after the 
user has tried the procedures. 

This indirect conflict indicates that there is a lag between installation 
of the innovation and feedback concerning use of the innovation. For designers 
to be aware of the usefulneks of their products, they must be in continuous 
contact with in Prrwakiinns regarding what users are presently doing. 

A major difference between the innovation and user system that can be viewed 
during analogical construction is the stability of tie descriptions. The program 


specifications represent an extremely stable pattern when compared to the user 
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practices. That is, they are the same from one time to another, one teacher to 
another, and one student to another. In short, they do not change. Both user 
practices and operational characteristics are much’ more flexible. Thus, in 
bapleneieertan, users must not only adopt and learn a new program but they must 
also become standardized in their practices. It is, perhaps, much more difficult 
for designers to etinhadize de sceclins of user's than it would bé to design 
more flexible products. Product flexibility may be achieved by describing different 
ways to achieve the same goal or achieving slightly altered goals. ° 

. Another major difference between the two systems is their relationship 
tothe goals and purposes of the innovation. The des{gners goals and purposes 
may be thought of as focusing their awareness. That is, the program specifica- 
tions that shey use must be within the domain defined by their goals and 
purposes. On one hand these act to guide the selection of appropriate 
specifications and provide an integrity to A tdaces design; on the other hand 
they act as blinders for program design. The user is not necessarily blinded 
in the same mannerf nor is his integrity necessarily tied to identical goals 
and purposes. In seats: the uaa hat the potential of being aware of a greater 
domain of alternatives than the designer. One may conclude that user's may 
have much to-offer to designers in terms of alternative program specifications, 
goals and purposes. 

In summary, the notion of bilateral change, as developed earlier in this 
study, has been shown to be applicable to otpdying implementation: both the 
immovation and the user were altered. Also, some afteta mons were unique 
and unpredicted by the program specifications and user practices, demonstrating 
that synergism seems applicable to the study of implementation. 

Operational characteristics that differ from program specifications and 


user practices were identified as mutual adaptations. Two types of mutual 


adaptations were discussed: those that were mixtures of and those that were 


He 


actually different than their related program specifications and user practices. 
Furthermore, mutual adaptations were viewed as adding pieces to the innovation, 


deleting pieces from it and substituting pieces. 


Alterations to the programs were related to conditions ,of the 
innovation and user which provide the opportunity for decision making situations. 
These situations result in\the programs alterations. The conditions discussed 
were; (a) the non-dynamic features of the user's environment, (b) the wiles 
programs that -the user operates, (c) emergent innovations, (d) the juccun teens 
of the innovation, (e) ramificatibns of other éitevations, and (f) the evaluative 
judgments-of—the-user,; 
afhe analogical construction used in ‘the study revealed that some conflicts 
May not occur until after initial implementation. This finding, combined with 
the discussion of the relationship of the user and designer to the goalg and 
ne of the innovation indicate a need to establish and maintain feedback 
systems from users tqi'designers. 


The construction also revealed that user systems are'more flexible than 


the program specifications. [hus, it may be beneficial to consider building 


more flexibility into program design. 


. 


CONCLUSIONS AND RECOMMENDATIONS FOR FURTHER RESEARCH 
The study has clearly shown that the innovation was impacted during 
implementation. Further study is needed to examine the impact of implementa- 


tion on the innovations at other sites’ using the LRDC model. Also, the study 


» needs to be replicated with the opération of other innovations. 


Of equal importance is the need to further study and clarify, the conditions 
and decision making that leads to the adaptations. It is necessary to determine 
whether these conditions are universally applicable, whether they apply to 
other sites using the LRDC model and whether they apply to sites using other 
models. 

Clearly, users, designers and implementors need to know more of these 
decision making situations. Are there "best" decisions? The wichdmatis 
nature of this winavton can be found in the acniy's identification of. two major 
user decisions which both egitvudticned the models design and agreed with 
Holland's research on effective programs. Interestingly, Wang's self-scheduling 


program (1974) illustrdtes how one may achieve greater flexibility without 


sacrificing specificity. The program allows for variance in user environment 


. and other programs that they operate. 


’ Within the context of bilateral change, it is important to consider the 
impdct that implementation has on the user. ‘While this impact is observable 


in the data concerning mutual adaptations on Table I, it must be noted that 


"the user system examined here was in analogy to the innovation, Certainly, 


3 
the user's system exists aside from that analogue. It has its own goals, 


purposes and practices that have not been considered in this study. The 


‘obvious counterpart to this study would be one focusing on the user system 


rather than the innovation system. 
Further study is also needed to examine how these operational character- 


istics, have altered the goals and purposes of the innovation. The writings of 
LY ‘ 
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Deutsch (1966) and Tolbert (1972) clearly indicate feedback systems that would 


be useful in this process. These feedback systems have been shown to be an 
essential learning aid to the designer. 

The extent to which "synergy" applies to implementation needs further 
clarification. This study has made progress in defining some of the com- 
ponent systems but much work needs to be done in that, area. 

Finally, the study has shown a need to re-think the implementation process. 
Implementors and designers are no longer working with a process of moving a 
user from a state of tensidén caused by goal-distance to a ates of homeostasis 
caused~by~goal-achievement.It~has been shown that the goals as well as the 
user, are in motion. Implementation, from this perspective requires steering 
systems. Such systems must rely-on knowledge of where the user is and what 
the changing goals of the innovation aré. Within*the system the goals (or 
goal-images) assume a tactical importance. Of real. importance ig the purpose 
of the user and designer working together. The notion and apidabittes of 
steering systems for implementation need extensive clarification. seniecat , 
is should be clear that the only real purpose of the organizations working 
together is to achieye educational ee for children. (That, too, needs 


further study and clarification.) 
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